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Introduction 

The field of sensitivity analysis is emerging as a fruitful area of 
engineering research. The reason for this interest is the recognition of the 
variety of uses for sensitivity derivatives. In its early stages, sensitivity 
analysis found its predominant use in assessing the effect of varying param- 
eters in mathematical models of control systems: see, for example, the texts 

of Tomovic (1963); Brayton and Spence (1980); Frank (1978); and Radanovic 
(l96b) for discussions of the early development of sensitivity theory. 

Interest in optimal control in the early 1960's (see, for example, Kelley, 
1962), and automated structural optimization (see, for example, Schmit, 1981) 
led to the use of gradient-based mathematical programming methods in »#hich 
derivatives were used to find search directions toward optimum solutions. 

More recently, there has been strong interest in promoting systematic struc- 
tural optimization as a useful tool for the practicing structural design 
engineer on large problems--a process still underway. Early attempts to use 
formal optimization for large structural systems resulted in excessively long 
and expensive computer runs. Examination of the optimization procedures 
indicated that the predominant contributor to the cost and time was the 
calculation of derivatives. As a consequence, there has been an emergence of 
interest in sensitivity analysis emphasizing efficient coinputational proce- 
dures. In addition, researchers have developed and applied sensitivity 
analysis for approximate analysis, analytical model improvement, and assess- 
ment of design trends--so that structural sensitivity analysis has become 
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more than a utility for optimization, but Is a versatile design tool In Its 
own right. Most recently, researchers In disciplines such as physiology 
(Leonard, 1974), thermodynamics (Irwin and O'Brien, 1982), physical chemis- 
try (Hwang, et a1., 1978), and aerodynamics (Dwyer and Peterson, 1980; 

Dwyer et a1., 1976; Bristow and Hawk, 1983), have been using sensitivity 
methodology to assess the effects of 

parameter variations In their analytical models, and to create designs which 
are Insensitive to parameter variation (Schy and Glesy, 1981; 1983). 

This paper Is a survey of methods applicable to the calculation of 
structural sensitivity derivatives for finite element modeled structures. 
Except for citing several general references, the paper does not deal with 
continuous (distributed parameter) models. The survey principally discusses 
literature published during the past two decades and the paper concentrates 
on four main topics: derivatives of static response (displacements and 

stresses), eigenvalues and eigenvectors, transient response, and derivatives 
of optimum structural designs with respect to problem parameters. The bulk of 
the survey deals with derivatives of the aforementioned responses with respect 
to gage-type variables such as rod cross-sectional areas, beam cross-sectional 
dimensions, anc plate thicknesses. Additionally, some works are reviewed In 
which the derivatives are calculated with respect to variables which define 
the shape of structural elements. Methods for calculating structural sensi- 
tivity derivatives are summarized in Table 1. 

Sensitivity of Static Response 

General Equations 

This section of the paper focuses on the calculation of derivatives of 
static structural response (displacements and stresses) computed from finite 
element models. The governing equation for displacement Is 
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KU » F 


( 1 ) 


where K is the symmetric stiffness matrix of order nxn 
U is the vector of displacement 
F is the vector of applied forces 

Both K and F are, in general, functions of design variables, v. A 
typical function of displacement (e.g., a constraint) will be respresented as 

g = g(u,v) 

( 2 ) 

U = U(v) 

Finite Difference Method 

A straightforward method of calculating derivatives of g is to use a 
finite difference approximation. For example 

p. „ g[U(v h), V ^•^h] - g[U(v), v] 

A serious shortcoming of the finite difference method is the uncertainty in 
the choice of a perturbation step size h. If the step size is too large, 
truncation errors may be excessive. These can be thought of as errors due to 
retention of only the lowest-order terms of a Taylor series representation of 
a perturbed function. If the step size is too small, condition errors may 
occur. Condition errors are due to inaccuracies in the calculation of the 
displacements and round-off errors in the finite difference calculation. 

Gill, et al, (1980, 1983) developed an algorithm to determine the optimum 
finite difference step size; i.e., one which balances the truncation and 
condition errors. The algorithm is based on approximating the truncation 
error as a linear function of step size h and the condition error as a 
linear function of 1/h. This technique has been tested on functions which 
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could be differentiated analytically for check purposes and was found to be 
very effective. Other work on finding optimum step sizes was done by Stewart 
(1967): Kelley and Lefton (1980); and Haftka and Malkus (1981). A recent 
paper by Haftka (1984) describes e technique for reducing condition errors in 
finite difference derivatives of response quantities obtained by iterative 
methods. 


Analytical Methods 

Analytical calculations of derivatives of displacements and functions 
thereof have been described by Arora and Haug (1976. 1979); and Haug and Arora 
(1978). In these references, three methods are described: the direct or 

design space method (attributed to Fox. 1965). the adjoint variable or state 
space method, and the virtual load method (attributed to Barnett and Hermann. 
1968). The virtual load method is a special case of the direct method. Both 
the direct and adjoint methods begin with the differentiation of equations (1) 
and (2). 


K 


^ = it 

dv ~ 3v 



( 4 ) 


^ = ia + 

dv 3v 


/mV dU 
Uu/ dv 


( 5 ) 


Direct Method . The direct method is to solve equation (4) for dU/dv 
and substitute dU/dv into equation (5). Equation (4) needs to be solved 
once for each design variable (v) so that the direct method is costly when the 
number of design variables is large. 

Adjoint Method . The adjoint variable or state space method has been 
extensively used in optimal control theory; see, for example. Kelley (1962). 
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The method starts by defining a vector of adjoint variables which satisfies 
the equation 



( 6 ) 


where ag/aU is sometimes referred to as the dumniy load vector.* Then using 
equations (4), (5), and (6) 


^ = ia 

dv av 


Jr.. 


( 7 ) 


The adjoint variable method requires the solution of equation (6) once 
for each function g. Therefore, If the number of functions Is smaller than 
the number of design variables, the adjoint variable method Is more efficient 
and conversely If the number of design variables is smaller, the direct 
approach is more efficient. Both the direct and adjoint methods Involve fewer 
computations than the finite difference approach which requires repeated 
factorization of the stiffness matrix, whereas the direct and adjoint methods 
require a single factorization with several right-hand sides. 

Chon (1984) developed a variant of the adjoint method via strain energy 
distribution and Implemented It In a proprietary version of NASTRAN. Hsieh 
and Arora (1983); and Gurdal and Haftka (1984) extended the adjoint method for 
boundary conditions which require specialized treatment while Haug and Choi 
(1984) suggest a generalization of the adjoint method that eliminates many of 
the problems associated with multi -point boundary conditions. Adaptation of 


*Note that If g is a particular displacement conponent, then ag/aU 
corresponds to a force of unit magnitude In the direction of the component 





the adjoint variable method to substructured finite element models Is 
described by Arora and Govll (1977). 

Calculation of aK/av . An Important conputatlonal task In the adjoint 
and direct methods Is the calculation of aK/av. If the structural model 
contains only elements whose stiffness matrix is proportional to v (such as 
rods where v is the cross-sectional area, or membranes and shear panels 
where v Is the thickness). aK/av Is a constant matrix. But for elements 
having bending stiffness such as beams and plates, the stiffness matrix Is a 
nonlinear function of the cross-sectional dimensions and the stiffness matrix 
derivatives are not easily evaluated (see Giles and Rogers. 1982). Hence, the 
preferred approach is to conpute aK/av by finite differences as In Prasad 
and Emerson (1982); Camarda and Adelman (1984); and Uallerstein (1984). 

Derivatives with Respect to Shape Design Variables 

Shape design variables typically control the shape of the boundary of the 
structure— for example, variables controlling the shape of a hole (and thereby 
the stress concentration factor at the hole boundary). The calculation of 
derivatives with respect to shape design variables Is In the early stages of 
development and there are unresolved Issues. Differentiating the finite 
element equations to obtain equation (4) has two disadvantages. First, even 
small changes of the boundary can change the entire finite element mesh and 
therefore, the calculation of aK/dv can be quite costly. Second, changes In 
shape can lead to the distortion of the finite elements and reduced 
accuracy. Thus, the derivatives obtained from equation (4) have a spurious 
component which reflects the changing accuracy of the solution when the mesh 
Is distorted (Botkin. 1982;Benn9tt and Botkin. 1983). 
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Because of the above, there has been substantial work In obtaining 
sensitivity derivatives by differentiating the continuum equations before 
discretizing. Derivations based on the concept of material derivatives have 
been proposed by Chun and Haug (1978, 1979, 1983); Rousselet and Haug (1981, 
1983); Rousselet (1983b); Zoleslo (1981); Choi and Haug (1983); Dems and 
Mroz (1984a); Bralbant and Fleury (1984); Yoo, Haug, and Choi (1984); Choi 
(1984); and Yang and Choi (1984). However, computational experience using 
equation (4) does not indicate that mesh-dlstortlon-derivative errors are 
significant (possibly due to the use of elements which are not sensitive to 
distortion). The material -derivative approach seems to suffer from numerical 
difficulties associated with the evaluation of boundary Integrals (see Yang 
and Choi, 1984). While some of these computational difficulties may be 
eliminated by replacing boundary by volume Integrals (Choi and Haug, 1984), at 
the present there Is no clear indication as to which method Is preferable. 

Calculation of Second Derivatives 

Second derivatives of displacement and constraint functions are used for 
approximate analysis (e.g., Noor ana Lowder, 1975), and for the calculation of 
derivatives of optimal solutions (see subsequent section on this topic). Such 
derivatives may be obtained by differentiating equations (4) and (5), for 
example. 
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d^U . ^“^v dU 

^--3v-"irav 



> ( 8 ) 
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HoMever, for m design variables there are m(in * l)/2 second derivatives* 
and equations (8) need to be solved for that many right-hand sides. It Is 
possible to proceed with an extension of the adjoint variable method proposed 
by Haug (1981b); and Dems and Mr6z (1984b). However* a more efficient 
approach proposed by Haftka (1982) Is to use equation (6) to obtain 



^•^v du\ 

■jravy 


(9) 


This approach requires the solution of equation (4) for all the first 
derivatives and equation (6) for all vectors of adjoint variables. 

Second derivatives were also derived by Van Belle (1982)* using 
flexibility rather than stiffness matrices. Finally* Jawed and Norris (1984) 
described a procedure for approximating higher order derivatives from the 
first derivative Information* which is equivalent to Introducing Intermediate 
variables. 


Stress Derivatives 

The stresses In an element may be obtained from the displacements using 


a * SU - GT (10) 

where a Is a vector of element stresses 
T Is an element temperature 

S and G are stress-displacement and stress-temperature matrices* 
respectively. 

Derivatives of stresses may be obtained by differentiating equation (10) 


do 

3v 


S 



3V 


. iO. T 

3V 


( 11 ) 
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For finite elements such as rods, membranes, and shear panels, S and G are 
Independent of v and stress derivatives are obtained by simply substituting 
dU/dv Into equation (11). For bending-type elements, S and G may be 
functions of v and the complete expression must be used; see Camarda and 
Adel man (1984), 

Nonlinear Analysis 

When geometric or material nonllnearltles are Important, equation (1) Is 
no longer valid and the displacement U Is calculated from a system of the 
form 


F(U.v) = 0 (12) 

where F is a vector of nonlinear functions. Derivatives are obtained by 
differentiating equation (12) with respect to v 


J 


dv 



(13) 


where the Jacobian 0 is aF/aU (often referred to as the tangential stiff 
ness matrix). The derivative of any constrain!: g may be calculated by 

solving equation (13) for dU/dv and then substituting into equation (5)-- 
thls is the direct method. Alternatively one can solve for the adjoint 
vector X from 



(14) 


and calculate dg/dv from equation (7) using Rv from equation (13). 
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Applications 

Applications of displacement sensitivity derivatives for formal optimi- 
zation are described, for example. In Nguyen and Arora (1982); Arora (1980); 
Prasad and Haftka (1980); and Schmit and Farshi (1974). Use of d1sp1acemr>> 
and stress derivatives to construct explicit constraint approximations 1; 
described, for example, by Schmit and Farshi (1974); Storaasll and 
Sobleszczanski (1974); and Noor and Lovder (1975). A basic example of such an 
approximation Is 

U(v*) . U(v) + ^ Av (15) 

where U(v) Is the displacement vector for the design variable v, U(v*) Is 
the vector corresponding to the new design variable v* > v -t- av. Numerous 
examples of application of stress derivatives In formal optimization are cited 
In the survey by Schmit (1981). Less well known Is the use of sensitivity 
derivatives of stresses to effect design changes without formal optimization. 

A good example of this Is reported by Musgrove, et a1. (1983). The most 
common application of sensitivity calculations In nonlinear static response 
are of derivatives of U with respect to a load parameter. Such derivatives 
are useful In Incremental solution procedures of equation (12) or f^»r reduced 
basis solution of this equation (see, for example, Noor and Peters (1980). 
Finally, readers Interested In the topic of static response sensitivity of 
distributed parameter systems are referred to Haug and Komkov (1977); Haug and 
Rousselet (1980a); Haug (1981a); and Rousselet (1983a); as well as the text of 
Haug, Komkov, and Choi (1984). 
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Sensitivity of Eigenvalues and Eigenvectors 
The general problem is to compute derivatives of eigenvali ''s and 
eigenvectors with respect to design variables or system parameters. For 
reference purposes, the most general case considered is the following 


eigenvalue problem: 


AX » xBX 

(16) 

Y^A • xY^B 

(17) 

Y^BX - 1 

(18) 


where x is an eigenvalue (generally complex). The generally nonsymmetric 
real nxn matrices A and B are assumed to be explicit functions of a set 
of design variables v. And X and Y are right and left eigenvectors, 
respectively. The first result on eigenvalue derivatives was published by 
Jacobi (1846) who developed the result for the special case of symmetric A, and B >> ^ 


3 X w T 3A Y 

dv * 3V 


(19) 


Wittrick (1962) applied Jacobi's formula for the case of a symmetric matrix to 
the derivatives of buckling eigenvalues and presented results for the change 
in buckling loads of plates with respect to aspect ratio and thickness. 
Lancaster (1964) developed a rigorous treatment of eigenvalue derivativ., and, 
in particular, showed that for multiple eigenvalues, the derivatives them- 
selves are solutions of an eigenvalue problem. The issue of multiple eigen- 
values was also investigated by Simpson (1976); and Haug and Rousselet 
(1980b), who showed that while simple eigenvalues are differentiable 
(Frechet), multiple eigenvalues are only diractlonally (Gateaux) 
differentiable. 
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Two methods developed for sensitivity analysis of electronic networks are 


notable fo«* their non-reliance on eigenvectors In the eigenvalue derivative 
formulas. Rosenbrock (1965) and Morgan (1966) developed formulas for eigen- 
value derivatives In terms of the matrix A and Its eigenvalues. According to 
Morgan's own assertion however, the computational effort Is not much less than 
If eigenvectors were required and examination of the details of their methods 
Indicates that the calculations are eo*<1va1ent to those required for computing 
eigenvectors. 

Other contributions from the electronics discipline Include the use of 
the adjoint network theory. An adjoint network or structure Is one with the 
same geometry and nodal connections as the actual configuration, but the ele- 
ments of the adjoint system may be linear even though the actual elements are 
nonlinear. Vanhonacker (1980) has used the theory of adjoint structures to 
derive formulas for derivatives of eigenvalues and eigenvectors of structures. 

Fox and Kapoor (1968) and Fox (1971) considered the special case of 
symmetric A and B matrices, but developed techniques applicable to more 
general cases. For eigenvalues, their foritula Is 

17 ■ » H) * «<" 

wherein It Is assumed that the eigenvectors are normalized such that 

X^B X » 1 (21) 

For eigenvector derivatives, two methods are presented by Fox and Kapoor. The 
first Is to differentiate equation (16), giving a set of simultaneous equa- 
tions for the eigenvalue and eigenvector derivatives. A complication here Is 
that the equations for the eigenvector derivatives are singular and the set Is 
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solvable only after algebraic manipulation which destroys the banded nature of 
equations, a point which arises later in connection with another method. The 
second method for eigenvector derivatives, developed by Fox and Kapoor, is to 
expand the derivative as a series of eigenvectors. Thus, for the i-th eigenvector 


3 X. n 

^ = V a.^X^ (22) 

3v ik k 

k=l 

Tne coefficients a^j^ are obtained by substituting equation (22) into equa- 
tions resulting from differentiating equation (16). In principle, it is 
necessary to use all n modes in the expansion of equation (22). However, as 
with the modal method generally, it should be possible to obtain reasona'rle 
results with fewer than n eigenvectors. Study of the convergence properties 
of equation (22) is clearly called for. Fox and Kapoor's second method was 
specialized by Hirai and Kashiwaki (1977) for the case of design variables 
controlling only a small part of the structure. Rogers (1970) and Stewart 
(1972) derived sensitivity formulas for eigenvalues and eigenvectors of the 
general problem (eqs. (16) and (17)). For eigenvalues, the equation is 

W • ''"(I7 - ‘ f) * <“> 

Rogers expressed the derivatives as an expansion in terms of the eigenvectors 


3X . n 

iT" " X ^ik\ 

k=l 



k=l 


^k^k 


(24) 
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The coefficients a^|( and are computed by substituting equations (24) 

Into an expression obtained by differentiating the eigenvalue problem and 
combining It with appropriate orthogonality conditions. Plaut and Husseyin 
(1973), as well as Rudislll (1974); and Doughty (1982), developed the same 
results as Rogers and. In addition, developed a formula for second derivatives 
of eigenvalues. Formulas for the second derivatives of eigenvectors are 
presented by Taylor and Kane (1975). Garg (1973) Investigated the case where 
A and B were complex and produced formulas for the eigenvalue and eigen- 
vector derivatives. His eigenvector derivative procedures are analogous to 
those of Fox and Kapoor. Rudislll and Chu (1975) developed the same 
eigenvalue derivative formulas as Rogers. Additionally, for eigenvector 
derivatives they extended Fox and Kapoor's first formulation to the case 
where A and B are nonsymmetrlc. They suggest two ways to solve the 
equations for the derivatives; an Iterative method which converges to the 
derivatives of the lowest eigenvalue and corresponding eigenvector; and an 
algebraic method which Is an extension of Fox and Kapoor's first method. 

Andrew (1978 and 1979) provided some proofs and refinements of Rudlslll's and 
Chu's algorithm. Brandon (1984) showed that second derivatives of eigenvalues 
may be calculated by using the first derivatives of the eigenvectors. 

An alternate method for calculation of eigenvector derivatives Is due to 
Nelson (1976). Differentiating the eigenvalue problem of equation (16) gives 

• - (U - # B - » H) X (25) 

The matrix A - x8 Is singular since \ Is an eigenvalue. The method of 
Nelson is to represent the eigenvector derivative as 

I7 - V + cX (26) 

14 





where V Is the solution of a reduced version of equation (25) obtained by 
deleting the kth row and column from A - xB (where k Is chosen arbi* 
trarlly), and setting the kth conponent of V equal to unity. The nultlpller 
c Is evaluated by substituting equation (26) Into an equation obtained by 
differentiating equation (21). This method has certain advantages over 
previous eigenvector derivative techniques: It requires only the eigenvalue 

and eigenvector for the mode being differentiated, and the equation for V 
retains the banded character of coefficient matrix (unlike the algebraic 
methods of Fox and Kapoor. Plaut and Huseyin. and Rudlslll). Cardani and 
Mantegazza (1979) extended Nelson's method to transcendental flutter 
eigenvalue problems. Flutter eigenvalue derivatives were also derived by 
Rudlslll and Bhatia (1972;, Rao (1972), Seyranlan (1982), and by Pedersen and 
Seyranlan (1983). Derivatives of nonlinear buckling eigenvalues were obtained 
by Kamat and Ruangslllansingha (1984). Finally, for the sensitivity analysis 
of eigenvectors of distributed parameter systems papers by Farshad (1974), 

Haug and Rousselet (1980b) and the text by Haug, Komkov, and Choi (1984) 
should be of Interest to readers. 

Sensitivity of Transient Response 

General 

The discussion of sensitivity analysis of transient structural response 
is usually based on the equations of motion which are written as a system of 
second order differential equations. However, this form obscures the 
similarity of structural sensitivity analysis to sensitivity analysis In other 
fields where first order differential equations are employed and Is also less 
compact than a first order formulation. For these reasons the discussion will 
be based on a system of first order ordinary differential equations of the 
form 
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0 « F(U,t.v) 
U(0) - Uq 


(27) 


where U Is the response, F is a vector of functions, t is time, v is a 
typical design parameter, and a dot denotes differentiation with respect to 
time. In many structural applications the left-hand side of equations (27) is 
aO where A is a matrix, and the methods discussed below are also applicable 
to that more general form (see, for example, Haftka and Kamat, 1984). 

Direct Method 

The direct method of obtaining sensitivity derivatives is based on 
differentiating equations (27) to obtain 

dU _ j ^ ^ 3F 
37 " ” dv ~ av 

(28) 

f (0) - 0 


where the Jacobian J is aF/aU. Note that equations (28) is a system of 
linear differential equations, even if the original system, equations (27) is 
nonlinear. Often, derivatives of the entire vector U are not required. 
Instead it is required to obtain the derivatives of a function of U of the 
form 

9(U»v) = I ^ p(U,t,v)dt (29) 

^0 


where t^ is a final time for the response calculation. The direct approach 
obtains dg/dv as 
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( 30 ) 


where dU/dv Is calculated In equations (28). 

Green *s Function Method 

Equations (28) have to be solved once for each design variable, and are 
costly when the number of design variables Is large. When the number of 
design variables Is larger than the dimensionality of U, then the Green's 
function approach (see Hwang. Dougherty. Rabitz, and Rabitz. 1978) Is more 
efficient than the direct approach. An application of this approach Is 
sensitivity analysis of transient structural response when the response Is 
conputed using reduction techniques such as modal analysis (e.g.. see Haftka 
and Kamat. 1984; Young and Shoup. 1982). The sensitivity derivative. 
dU/dv. Is written as 

where the Green's function K satisfies (recall that the dot denotes d/dt) 
K(t.t) =0 t < T 

K(t.O » I (32) 

^(t.x) - 0(t) K(t.r) “0 t > T 

T'-;e efficiency of the Green's function approach Is partly governed by the 
method used to Integrate equations (32). A large amount of work on the 
efficient 1.<plementat1on of the Green's function approach has been performed 
by Rabitz and co-workers (Oemirlap and Rabitz. 1981; Dougherty. Hwang, and 
Rabitz. 1979; Dougherty and Rabitz. 1979. 1980; Esiava. Eno. and Rabitz. 1980; 
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Kramer and Calo, 1981; Kramer, Calo, Rabitz, and Kee, 1982; Rabitz, 1981). 
Their approach Is Implemented In a general purpose computer code called AIM 
(Kramer, Calo, Rabitz, and Kee, 1982). The Green's function method Is also 
known as the variational method (see, Dogru and Seinfeld, 1981). 

Adjoint Variable Method 

Further Inprovements In efficiency may be possible If less Information Is 
needed. If Instead of the derivatives of the entire vector U, only those of 
a few functionals (e.g., eq. (29)) are required, then an adjoint variable 
method Is called for. The adjoint variable approach solves first for the 
adjoint vector a from the differential equation 


A + J A 


T* = i£ 


dU 


A(t^) = 0 


(33) 


It Is shown by Haftka and Kamat (1984) that 



Equation (33) Is a set of linear differential equations which Is Integrated 
backwards from tf to zero. As In the steady state case, the adjoint 
variable approach Is preferred over the direct approach when the number of 
functionals Is less than the number of design variables. The adjoint variable 
approach has been applied to a variety of problems Including dynamics (Ray, 
Pister, and Polak, 1978; Haug, Wehage, and Barman, 1981), atmospheric 
diffusion (Hall, Cacuci, and Schlesinger, 1982), nuclear processes (Oblow, 
1976), and heat transfer In structures (Haftka, 1981). 
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Finite Difference Method 


For sensitivity analysis of static response, the finite difference 
approach is a1nx)St always inferior to analytical methods. For the calculation 
of derivatives of transient response this is not always the case. When 
explicit methods are used for integrating the differential equations, the 
linearity of the sensitivity equations does not constitute a computational 
advantage. Therefore, for the case of explicit integration the finite 
difference approach is often computationally superior to the direct method 
(see Haftka, 1981; and Haftka and Malkus, 1981). When implicit integration 
techniques are used, the finite difference approach is less attractive 
computationally, but remains easier to implement than the direct approach. 

FAST Method 

All the approaches discussed above provide local sensitivity informa- 
tion. The Fourier Amplitude Sensitivity X®st (FAST) method (see review by 
Cukier, Levine, and Shuler, 1978) provides global sensitivities. FAST is 
typically used to assess sensitivities to parameter uncertainties. This is 
done by systematically sampling solutions obtained by varying the parameters 
which have a range of uncertainty. If there are m parameters 
v^-, i = l,...,m, the sampling is performed in an m-dimensional space. FAST 
converts this m-dimensional space to a one-dimensional space in terms of a 
variable s by using the transformation 

Vi = ai + b^ sin w^s (35) 

where w^, i - l,...,m are a set of incommensurate frequencies and a^, b^ 
are constants which depend on the range of variation v^. The solutions for a 
large number of s-values are sampled and a Fourier transform of the response 
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In terms of s Is obtained. The coefficient of the transform associated with 
w^ Is a direct measure of the sensitivity of the solution to v^. While FAST 
Is more efficient than a Monte Carlo sampling of the parameter space. It Is 
substantially more expensive than local sensitivity methods when m Is large. 

While In the literature reviewed herein FAST has been used only for 
calculation of sensitivities of transient response, the method Is equally 
applicable to steady-state or elgenproblem sensitivity calculations. The 
method has been applied extensively In physical chemistry (e.g., Koda, McRae 
and Seinfeld, 1979; Tllden and Seinfeld, 1982), and a computer Implementation 
is described by McRae, Tllden, and Seinfeld (1982). 

Other Forms of Transient Response Equations 

A specialized form of transient structural response Is the response to 
harmonic excitation. The sensitivity analysis of that response Is very 
simlla* to the sensitivity analysis of static response— (see, for example, 
Wang, Kitls, Pllkey, and Palazzolo, 1982 and 1983, and Yoshimura, 1984). 

The system of equations (27) Is typically obtained by discretization of 
the spatial variation (e.g., by finite elements) before the sensitivity 
analysis Is performed. In some applications (see, for example, the discussion 
of static shape sensitivity) It may be advantageous to perform the sensitivity 
analysis before discretizing. Koda, Dogru, and Seinfeld (1979); Dwyer and 
Peterson (1980); and Koda and Seinfeld (1982), for example, discuss applica- 
tions of sensitivity techniques to partial differential equations, while 
Gibson and Clark (1977) and Cacuci (1981) present sensitivity analysis In the 
general setting of functional analysis. 
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Second Derivatives 


Part of the motivation for second derivatives Is that they estimate 
nonlinear sensitivity effects Including Interaction between variables. Second 
derivatives may be calculated directly. For example, differentiating 
equations (28) 


17 


d^U . 

17 ' 


17 


^ 3v dv 


( 36 ) 


Unfortunately m design parameters result In m(m + l)/2 systems such as 
equation (36). If second derivatives are needed only for a functional g 
such as equation (29), then the calculation can '• greatly simplified. In 
fact. 



2 


dv dv] 


dt 


( 37 ) 


Thus, the solution for all the second derivatives requires only first deriva- 
tives of U plus the adjoint variable vector. This efficient approach to 
second order sensitivity calculations is not yet In use. The literature 
describes somewhat less efficient direct a..J adjoint techniques (e.g.. Coffee 
and Heimerl, 1983; Haug and Ehle, 1982) or finite difference techniques (e.g., 
Behrens, 1979). 


Sensitivity Derivatives of Optimal Solutions 
As the use of optimization techniques has expanded, there has been an 
Increasing Interest In the sensitivity of optimal solutions to probUm 
parameters. A typical situation where such derivatives are needed Is the 
following: Suppose the minimum weight design of an aircraft wing Is obtained 


by varying the sizes of the structural components while the geometry of the 
wing, the loading and the structural materials were fixed during the 
optimization process. Now suppose the minimum weight design is still too 
heavy and the designer needs to know which of the fixed parameters Is a good 
candidate for change. It would be useful to have the sensitivity of the 
minimum weight design to changes in such parameters. 

The information required for obtaining the sensitivity of an objective 
function such as minimum weight with respect to problem parameters is composed 
of a direct effect on the objective function plus an indirect effect through 
the change in the constraints. For example, the optimization problem may 
be posed as 

Minimize f(v) 


such that 


gj(v) > 0 j =» l,...,m (38) 

where f(v) is an objective function, v is a vector of design variables and 
gj(v) represent constraints. Let v*, f* be the solution to the problem 
and let p be a problem parameter. Then it is shown (see, for example, 
Barthelemy and Sobieski, 1983b) that 
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where Xj are the Lagrange multipliers associated with the constraints. The 
Lagrange multipliers thus have the role of the “price" of the constraints, in 
that xj is the change in the objective function due to a unit change in 
gj. Because most optimization algorithms yield the Lagrange multipliers or 
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estimates thereof as a by-product of the solution, the sensitivity of the 
objective function to problem parameters is easy to obtain. 

The sensitivity of the optimum set of design variables v* with respect 
to problem parameters is more complicated. Lagrange multipliers are not 
sufficient and additional calculations are required. Early work by Fiacco and 
McCormick (1968); Armacost and Fiacco (1974); Fiacco (1976, 1980); Bigelow 
and Shapiro (1974) and Robinson (1974) concentrated on the mathematical 
aspects (see also text by Fiacco, 1983). More recent papers by McKeown 
(1980a, b); Sobieszczanski-Sobieski , Bartheleny, and Riley (1982); and 
Vanderplaats and Yoshida (1984) discuss applications to the optimal design of 
dynamic systems and to structures. The calculation of the derivatives of v* 
requires second derivatives of the objective function and constraints with 
respect to the design variables, and thus poses a need for efficient computa- 
tional techniques to obtain these derivatives. 

As with other sensitivity derivatives, derivatives of optimal solution 
may be used to extrapolate solutions for problem parameter changes. Unfortu- 
nately, the sensitivity derivatives do not take into account changes in the 
active constraint set brought about by the change of parameters (see 
BartheleiR/ and Sobieski, 1983a). Consider, for example, a constraint which is 
almost but not quite critical for the optimum design. The Lagrange multiplier 
associated with the constraint must be zero and therefore as indicated in 
equation (39) , such a constraint does not contribute to the sensitivity of the 
objective function. However, a small change in the value of p can make the 
constraint critical and completely change the value of the derivative. This 
problem makes the use of optimal solution sensitivity derivatives more risky 
than some other derivatives. Sobieszczanski-Sobieski, Bartheleny, and Riley 
u982) suggested using derivatives of the Lagrange multipliers and the optimum 
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solution vector v* to anticipate changes In the active set. However, the 
effectiveness of this approach Is still In doubt with positive results 
obtained by Schmlt and Chang (1984) and negative results by BarthelenQr and 
Sobleski (1983a). 


Concluding Remarks 

This article surveys methods for calculating sensitivity derivatives for 
discrete structural systems and primarily covers literature published during 
the past two decades. Methods are described for calculating derivatives of 
static displacements and stresses, eigenvalues and eigenvectors, transient 
structural response, and derivatives of optimum structural designs with 
respect to problem parameters. Methods and selected references are summarized 
in Table 1. The survey Is focused on publications addressed to structural 
analysts, but also Includes a number of methods developed In nonstructural 
fields such as controls and physical chemistry which are directly applicable 
to structural formulations. Most notable among the nonstructural -based 
methods are the adjoint variable technique from control theory, and the 
Green's function and FAST methods from physical chemistry. 

For static displacements and stresses, methods are well established for 
derivatives with respect to simple sizing variables. Finite difference and 
analytical methods (direct and adjoint variable) are available and there are 
clear guidelines giving classes of problems where the various methods are 
preferred. Finite differences have long been disparaged as a method as 
compared to the more elegant analytical approaches — and Indeed the theoretical 
effort (as measured by operation counts, for example) of finite differences 
does greatly exceed that of the analytical approaches except for very small 
numbers of design variables, "owever, finite differences have a major 
advantage— it is extremely simple to formulate and Implement. This factor. 


24 



together with the Increased speed of recent and expected conputers, may 
explain Its popularity In many applications. 

Methods for derivatives with respect to shape design variables are less 
well established and consequently there are no clear choices of preferred 
techniques. One approach Is to differentiate a set of discretized equations 
from a finite element model with respect to the shape design variables. This 
method has the advantage of versatility but the disadvantage that when the 
shape changes, the finite element mesh may be distorted leading t "umerlcal 
Inaccuracies. An alternative approach Is to differentiate the co^.r. li'uum 
equations (before discretization) using a material derivative. This approach 
avoids the mesh distortion problem and Is potentially more efficient but Is 
more complex to Implement. 

With regard to derivatives of structural eigenvalue problems, well- 
established formulas are available for both real and complex eigenvalues. 
Derivatives of eigenvectors may be obtained by several methods Including 
expanding the derivatives as a series of eigenvectors, an algebraic approach 
based on simultaneous equations for eigenvalue and eigenvector derivatives, 
and a simplified but rigorous analytical approach developed by Nelson. The 
method of Nelson Is most appealing as It combines mathematical rigor with 
computational si.npllcity. The modal expansion method also merits considera- 
tion but requires a study of the convergence properties of the technique. 

Derivatives of transient structural response may be obtained using finite 
differences, direct and adjoint variable analytical methods, a Green's func- 
tion technique and the Fourier amplitude test - FAST (the latter two methods 
developed by physical chemistry researchers). As In the static case, there 
are established guidelines for deciding when to choose among the various 
methods. Unlike the static case, the finite difference method may be 
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conpetltlve on the basis of computational efficiency. For example* If an 
explicit numerical Integration algorithm Is used for the nominal solution* a 
finite difference calculation of the derivative may be more efficient than an 
analytical method. 

Methods for derivatives of optimum designs with respect to problem 
parameters are reviewed. Because this Is a relatively new topic* the body of 
literature was not large. The derivative of the objective function can be 
easily obtained by a reasonably simple formula. The derivatives of the 
optimum design variables are somewhat more difficult to obtain. A complica- 
tion which arises In using these derivatives to extrapolate an optimum design 
1$ that one must keep track of constraints which change from norcrltlcal to 
critical as a result of small parameter changes. Finally* a significant 
by-product of the Interest In derivatives of optimum designs Is the motivation 
It has provided for research in Improved methods for second derivatives of 
response quantities. 
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Table 1. Sumnary of analytical methods for structural sensitivity derivatives 
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♦Finite difference methods are generally applicable. See, for example, fill! (1980, 1983), Stewart (1967) 
Kelley and Lefton (1980), Haftka and Malkus (1981) 



